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TITLE OF THE INVENTION 
ITINERARY BASED AGENT MOBILITY INCLUDING MOBILITY OF 
5 EXECUTABLE CODE 

CROSS REFERENCE TO RELATED APPLICATIONS 
A claim of priority is made to U.S. provisional patent 
application Serial Number 60/030,906, entitled USE AND 
10 COLLABORATION OF MOBILE AGENTS IN A COMPUTER NETWORK , filed 

November 14, 1996. 

STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR 
15 DEVELOPMENT 

Not applicable 

BACKGROUND OF THE INVENTION 

20 The present invention is generally related to network 

computing, and more particularly to mobile objects. 

Mobile objects that are transmitted across a computer 
network are known. Mobile objects are comprised of code and 
data, both of which are transmitted across the computer 

25 network. Technologies such as client -server protocols, 

remote procedure call protocols, and distributed object 
technologies are employed to transmit mobile objects across 
the computer network. These technologies implement either 
a "push" model or a "pull" model, both of which have 

3 0 drawbacks. 

In a "pull" model the code for an executing object is 
downloaded from a network source such as a web server. When 
a particular portion of code becomes necessary for operation, 
that portion of code is first sought on the local filesystem. 

35 if the local filesystem does not include that portion of the 

code, a network request is sent to another computer in the 
network in order to prompt transmission of that portion of 
code to the local computer. However, as different classes 
of sub-objects are created, a separate network request must • 
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be sent to retrieve code for each class. In the case of a 
Hyper-Text Transfer Protocol ("HTTP") request, each request 
must re-establish a Transmission Control Protocol/Internet 
Protocol ("TCP/IP") socket connection to the web server. 
5 Thus, when downloading a large number of classes, a large 

number of connections must be established and a large amount 
of network overhead is incurred. 

Another drawback associated with the pull model is that 
as an object travels, the code which enables the object to 
10 operate must be re-downloaded at each computer. More 

particularly, when the object arrives at each a destination 
computer, the object downloads any code which is required but 
not present on the local filesystem, even if that code was 
downloaded at the previous destination computer. Previously 
15 downloaded code is not cached. Network overhead is incurred 

as a consequence. 

In a "push" model the code for an executing object is 
carried with the mobile object. Prior to launching the 
mobile object, all of the code that will be needed by the 
20 object is identified. The code is packaged with the agent 

and pushed around the network to each destination computer. 
While the push model reduces network requests in comparison 
with the pull model, network overhead is still incurred 
because of the relatively large amount of code that is pushed 
25 to every destination computer. In some cases the object will 

push code for classes that are no longer needed. For 
example, an agent may create an instance of a particular 
class of object only in very exceptional circumstances. In 
such a case it is inefficient for the object to push the code 
30 for this class. 

Another limitation of known mobile objects is difficulty 
in examining and predicting destination information. Known 
mobile objects initiate travel by performing a subroutine 
call. The method is sometimes given a name such as "go" or 
35 "moveTo," and the' caller is responsible for specifying a name 

or Uniform Resource Locator ("URL") indicating the 
destination computer for the mobile object. When the travel 
method is called, the execution of the mobile object is 
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halted and the mobile object is converted into a network 
transmittable form. On the destination computer the mobile 
object is restored from the network form and restarted. This 
restart can either occur on the instruction directly 
following the call to the travel method, or at the beginning 
of some known method. 

BRIEF SUMMARY OF THE INVENTION 
In order to provide efficient mobility of code for a 
mobile agent object ("agent"), a "mobile codebase" object is 
constructed. The mobile codebase travels with the agent and 
serves as a repository of code for classes that facilitate 
agent operation. When the agent is launched, the launcher 
specifies a list " of related classes. - These classes are 
retained in the mobile codebase. The launcher also specifies 
a Uniform Resource Locator -("URL") that points to a network 
source ("home codebase") from which code can be downloaded. 
If the agent is required to instantiate an object comprising 
code that is not in the mobile codebase, a network request 
is sent to the home codebase to retrieve that code. Code 
that is downloaded in this manner is retained in the mobile 
codebase . 

The combination of the mobile codebase and home codebase 
improve agent operation and reduce network overhead. In a 
preferred embodiment an agent is launched with a mobile 
codebase that is preloaded with classes which are certain to 
be needed. Classes that are unlikely to be needed are stored 
in the home codebase. Thus the agent with mobile codebase 
and home codebase provide the desirable, features of the push 
and pull models without the undesirable network overhead 
incurred by transmitting unneeded classes around the network 
or re -downloading code. 

Agent travels are defined by an itinerary data 
structure. The itinerary is composed of a list of 
' destinations, each of which includes: (1) the hostname of a 
destination computer on the network to which the agent should 
travel, and (2) the name of a method that the agent should 
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10 



15 



35 



execute when the agent arrives at the destination computer. 
An agent is allowed to modify its itinerary. When an agent 
modifies its itinerary, the agent owner is automatically 
notified, thus allowing the owner to "follow" the agent 
wherever it may travel. 

The itinerary provides advantages related to agent and 
network management. Inspection of the agent itinerary 
reveals where the agent has travelled and where the agent may 
travel in the future. Since the itinerary is a standard data 
structure, an observer can depend on it to be present. 
Further, since the itinerary is a separate data structure 
from the agent, the observer does not need special knowledge 
of the internal structure of the agent in order to examine 
the itinerary. 



BRIEF DESCRIPTION OF THE DRAWING 
The invention will be more fully understood from the 
following Detailed Description of the Invention, in 
20 conjunction with the Drawing, of which: 

Fig. 1 is a block diagram which illustrates agent 
migration; 

Fig. 2 is a block diagram which illustrates agent 
execution in conjunction with agent migration; 
25 Fig. 3 is a block diagram of an agent; 

Fig, 4 is a block diagram of agent interaction with 
agent managers on multiple computers in a network; 

Fig. 5 is a flow chart which illustrates agent mobility; 

Fig. 6 is a block diagram which illustrates agent 
30 operation according to an itinerary; 

Fig. 7 is a block diagram which illustrates the agent 
runtime environment; and 

Fig. 8 is a flow chart which illustrates agent 

deserialization. 



DETAILED DESCRIPTION OF THE INVENTION 
Referring to Fig. 1, an agent 10 comprises a mobile'' 
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object which can travel from a first computer 12 to a second 
computer 14 in a computer network 16. The agent is generated 
and stored in memory on the first computer for a specific 
purpose, and includes both data and executable code. The 
5 agent executes on the first computer and then migrates to the 

second computer by being transmitted across the network. The 
agent then resumes execution on the second computer. When 
the agent completes execution on the second computer, the 
agent acts in accordance with an agent itinerary. For 

10 example, the agent will migrate to another computer if the 

itinerary so indicates. 

Referring now to Figs . 1 and 2 , the agent executes a 
sequence of instructions during operation. In particular, 
a first method 18 is executed on the first computer 12 and 

15 a second method 20 is executed on the second computer 14. 

As a result, migration between computers is transparent from 
the perspective of the agent. 

Referring to Fig. 4, agent mobility is preferably 
facilitated through use of JAVA agent manager Objects 32 and 

20 an Object Serialization facility (a product of ■ Sun 

Microsystems which is known in the art) . Object 
Serialization operates to serialize objects such that a 
representative stream of bytes, i.e., data, is generated 
therefrom. Object Serialization facilitates transmission of 

25 an agent across the network by serializing the agent 10 into 

a format that is suitable for network transmission. 
Serialization of the agent may also include serialization of 
sub-objects which are contained within member variables of 
the agent. In accordance with the present invention, the 

30 serialization process involves the serialization of 

executable code, data, and an itinerary as hereinafter 
discussed in greater detail. Once the agent has been 
serialized, a communication socket to the second computer is 
opened and the resulting stream of bytes is transmitted to 

3 5 the second computer along the socket. 

The serialized agent is regenerated in the second 
computer 14 upon arrival. In particular, the stream of bytes 
transmitted along the socket is deserialized in the second 
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computer. Deserialization regenerates the agent in the form 
in which the agent existed prior to migration, i.e., an 
object. Following deserialization, the agent executes a 
predetermined method specified by its itinerary. The 
5 predetermined method may prompt interaction with another 

object 34 located on the second computer. When the method 
has been executed, the agent is serialized and transmitted 
to yet another computer, or possibly back to the first 
computer. The agent is therein deserialized upon arrival and 

10 1 proceeds to execute another predetermined method and interact 

with that computer. In the case of the agent migrating back 
to the first computer, such interaction could be with a host 
application 3 6 through which an information query was 
entered. The agent continues migrating across the network 

15 in this manner as execution requires. Eventually, the agent 

is terminated when execution of the itinerary is complete. 
It should be noted that the agent need not necessarily 
migrate to the initial host (first) computer after executing 
on a remote (second) computer. The agent could travel to 

20 multiple computers, and may not return to the initial host 

computer . 

Referring to Fig. 3, each agent may include data 22, 
code 24, sub-objects 26 and an itinerary 28. The data 
portion 22 includes internal state information associated 

25 with the agent. The code portion 24 includes executable code 

associated with operation of the agent. The itinerary 
portion 28 specifies destinations for the agent. Sub-objects 
26 include code of distinct objects contained within the 
agent. The agent carries the code for these sub-objects. 

30 The code 24 portion of the agent 10 includes a mobile 

codebase and a reference pointer to a home codebase . The 
mobile codebase comprises executable code which is retained 
as part of the agent. When the agent migrates, the mobile 
codebase is transmitted along with the data, sub-objects and 

35 itinerary to the destination. The home codebase is 

executable code which resides on the computer which 
originally created and launched the agent or a suitable 
network server (such as a web server) . The reference pointer 
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to the home codebase is a Uniform Resource Locator ("URL") 
that allows remote access to the home codebase from other 
computers in the network. If the agent requires code that 
is not present in the mobile codebase during execution, the 
5 agent retrieves the required code from the home codebase and 

retains such retrieved code in the mobile codebase. 

Referring to Figs. 3 and 6, the itinerary 28 is a data 
structure which defines agent migration parameters. The 
itinerary is composed of a list of destinations and the name 

10 of a method associated with each such destination. In a 

preferred embodiment, each destination entry contains the 
Transmission Control Protocol/Internet Protocol ("TCP/IP") 
host name of a computer on the network to which the agent is 
designated to migrate. The method associated with the 

15 respective destination is invoked upon arrival at that 

destination. Hence, each destination represents a location 
and a task to be performed at the location. 

Figs. 4 and 5 illustrate agent mobility. When the 
determination is made that the agent should migrate, the 

20 agent manager 30 examines the itinerary 28 to ascertain the 

next destination to which the agent 10 is designated to 
migrate. The agent manager 30 establishes a network 
connection to the agent manager 32 at the destination 
computer 14. The agent manager 30 passes the agent and 

25 related travel information to the destination agent manager 

32. The" agent manager 30 then deletes the local copy of the 
agent, terminates any execution threads which were being used 
by the agent, and performs other appropriate clean up 
activities . 

30 From the perspective of the destination computer, the 

agent arrives at the destination computer as illustrated in 
step 38. As previously described, the agent arrives in the 
form of data which includes the code, sub-objects, itinerary 
and other data. Java/Object Serialization assists the de- 

35 serialization and reconstruction of the agent as depicted in 

step 40. The server then spawns a new thread in which the 
agent will execute as shown in step 42. A persistent local 
copy of the agent is then made as illustrated in step 44. 
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As depicted in step 4 6 the agent manager invokes the proper 
method of the agent for execution in the spawned thread at 
this node. The itinerary contains information indicating 
which method should be invoked at each designated destination 
computer. The agent then executes as illustrated in step 50. 

When the agent has completed execution of the indicated 
method, another persistent copy of the agent is stored on the 
local disk as depicted in step 52 in order to prevent 
redundant execution in the event that the computer 
malfunctions before the agent migrates. The agent manager 
then examines the agent itinerary as illustrated in decision 
step 54. If the itinerary does not indicate any further 
destinations then agent execution is deemed complete as shown 
in step 56. However, if the itinerary indicates further 
destinations, then the agent manager determines whether the 
next destination is associated with another computer in 
decision step 58. If the next destination is not another 
computer, flow returns to step 44, thereby bypassing network 
traffic. However, if the next destination is associated with 
a different agent manager then a network connection to the 
indicated agent manager is established as depicted in step 
60. The destination contains a string which indicates where 
to travel. The string contains either the name (host name) 
of a computer or a URL to a distributed object. The agent 
is then serialized as illustrated in Step 62 and subsequently 
transmitted to the next agent manager as depicted in Step 64. 

Migration in accordance with the itinerary 28 is further- 
illustrated in Fig. 6. The itinerary includes a listing 
including identification of each agent manager 66 to which 
the agent is configured to migrate and identification of a 
method 68 to execute at each respective agent manager. The 
agent migrates through the agent managers listed in the 
itinerary sequentially in the order in which the servers are 
listed, invoking each respective method upon arrival. Such 
method could be, for example, querying or updating a database 
on the destination computer. 

Fig. 7 illustrates the agent runtime environment. Each' 
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computer 70 on the network includes a Java Virtual Machine 
72 running therein. A agent manager 74 runs on each 
respective Virtual Machine 72. The agent manager includes 
a plurality of threads 76; each thread having an agent 78 
associated therewith. In particular, a new thread is formed 
when a new agent arrives at the server, and the agent 
executes on that thread. Security mechanisms prevent each 
agent from operating outside the scope of the associated 
thread. When agent execution completes, the agent migrates 
to the next destination identified in the itinerary. 

In order for migration and execution to function 
properly, the agent manager modifies the mechanism by which 
Java loads classes. The Java standard library provides an 
object called a "ClassLoader" which can be subclassed by a 
programmer to modify the rules that Java follows to load 
classes. The ClassLoader class allows web browsers to 
download "applets" from a web server. The agent manager 
provides a specialized ClassLoader which allows the 
executable code for mobile agents to travel with the agent. 
20 During a typical execution of a Java program, a Java 

interpreter loads classes as needed for execution from a 
logical file system on the local computer. However, agents 
become separated from the home computer and the home codebase 
during migration, i.e., agents are separated from the 
25 directory or directories on the filesystem of the home 

computer where the code is stored. Further, sub-objects 
sometimes need to be created as the agent executes, either 
as member variables or as temporary variables within the 
methods. These sub-objects could be instances of classes 
3 0 which are part of the standard Java packages or they could 

be instances of new classes written by the programmer of the 
agent. However, since the agent is executing on a different 
computer than the home computer following migration, the Java 
virtual machine may not be able to directly retrieve the code 
35 for the particular sub-object. To allow agents to properly 

load classes and construct objects when remote from the home 
computer, a special ClassLoader is employed by the agent 
manager whenever an agent attempts to construct an object; 
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The ClassLoader object first attempts to locate a class on 
the local file system of the computer. If the class is not 
on the local file system, the ClassLoader searches the mobile 
codebase. If such attempt fails, the ClassLoader sends a 
5 request back to the home machine of the agent. The agent's 

travel information contains a reference such as a URL which 
refers back to the home codebase on the home computer, and 
by accessing the URL the ClassLoader can retrieve classes 
from the home computer. 

10 Agent deserialization is illustrated in Fig. 8. As 

depicted in step 80 the serialized agent arrives as a stream 
of data. Java Development Kit Object Serialization classes 
then call an agent manager related method to perform 
deserialization as shown in step 82. The method reads agent 

15 related objects from the object stream as depicted in step 

84. In particular, the mobile codebase, itinerary and 
codebase URL are read by the method. A custom Classloader 
and Object InputStream are constructed as shown in step 86. 
Object Serialization then reads the agent and other objects 

20 from the input stream as depicted in step 88 and step 90, 

respectively. When the related objects are read, the 
ClassLoader retrieves the classes which comprise the agent 
as illustrated in step 92. 

The new object's class is loaded once the classes are 

25 retrieved. As depicted in step 94, if the class is 

determined to have been previously loaded then the previously 
loaded class instance is employed (step 96 ) and the obj ect 
is instantiated using the loaded class object as shown in 
step 98. However, if the class has not been previously 

30 loaded as determined in inquiry step 94, then inquiry is made 

as to whether the class is on the local class path of the 
destination computer as illustrated in decision step 100. 
If the class is present on the local machine then the class 
is loaded therefrom as shown in step 102 and the object is 

35 instantiated using the loaded class object as depicted in- 

step 98. However, if the class is not found on a local class 
path as shown in step 100 then an inquiry is made as to 
whether the class is in the mobile codebase as shown in step 
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104. If the class is located in the mobile codebase then the 
class is loaded therefrom as shown in step 106 and the object 
is instantiated using the loaded class object as shown in 
step 98. However, if the class is not located in the mobile 
codebase in decision step 104 then the class is loaded by 
accessing the home codebase as shown in step 108. If the 
codebase pointer is an Internet type pointer such as a Hyper- 
Text Transfer Protocol ("HTTP") URL , as determined in inquiry 
step 110, then an HTTP request is sent to the local web 
server as shown in step 112 and the retrieved class is added 
to the Mobile CodeBase as depicted in step 114. However, if 
the codebase URL is not: a HTTP URL then a remote method 
request is sent .to a RemoteClassLoader object as shown in 
step 116 and the class is added to the mobile codebase as 
shown in step 114. In either case, the object is 
instantiated using the loaded class object as shown in step 
98. If more objects exist in the stream to be retrieved, as 
determined in decision step 118, then another object is read 
from the input stream as illustrated in step 90. If there 
are no more objects to be retrieved, flow terminates. 

Having described the preferred embodiments of the 
invention, other embodiments which incorporate concepts of 
the invention will now become apparent to one of skill in the 
art. Therefore, the invention should not be viewed as 
limited to the disclosed embodiments but rather should be 
viewed as limited only by the spirit and scope of the 
appended claims. 

A program listing follows in the attached APPENDIX- 
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collaborate with a specific Agent regarding a certain subject is not known a priori, but is. 
rather, determined as a result of the Agent's computations. ) 

Both the interaction between these Agents and the context in which they execute must be 
• formally specified. Standardization has not yet been achieved for these objectives. 
However, the prevalent means lor accomplishing these results is via implementing a user 
model and specifying queries and assertions by using a knowledge representation 
language, the most popular of which is currently Knowledge Query Manipulation 
Language (KQML), and by developing Ontologies, or vocabularies of common terms to 
be utilized by interacting Agents. KQML is comprised of both a language, with a syntax 
unlike procedural or object-oriented languages, and a communications protocol. An 
Ontology is defined as "an explicit specification of a conceptualization". The syntax and 
semantics of an Ontology are generally extensions of a first-order predicate calculus, 
typically the Knowledge Interlace Format (KIT). 

The combination of KQML. KIT. and Ontology development is a complex task. Some 
implementations utilizing these mechanisms are being developed in the Artificial 
Intelligence community. Nut this approach has not caught on in other software 
applications. 

In contrast to Intelligent Agents. Mobile Agents are usually explicitly programmed to 
accomplish a specific task. As an example, a Mobile Agent could migrate to travel 
agencies on the World Wide Web and determine the lowest cost air fare between two 
cities. In this case, there is no need for learned behavior or complex reasoning. 

However, the amount of information accessible on distributed systems, including 
databases, the Internet and Intranets, is growing at a staggering pace and much of it is 
available in incompatible storage formats. The need to filter information and make 
decisions based on its content is increasing, and with it. the need for increased 
collaboration among Mobile Agents. 

The need for collaboration is illustrated by extending the above travel agency example. A 
Mobile Agent may need to clone itself and instruct each of its counterparts to migrate to a 
different travel agency site to obtain the best package for a trip to one or more ski resorts 
meeting certain parameters, including air fare, lodging, me;d?;. lift tickets, and car rental. 
Furthermore, the information may, itself, he sioicd in different formats (databases, etc.). 
necessitating some amount of filtering and data reformatting. Once the Agents have 
obtained their information, they need to collaborate with each other to correlate their 
results and determine the best package available at each resort for different travel dates 
and the overall best deal. 

Mobile Agents are evolving :u include muw^ed miellije:K\: and collaboiation. Some 
research organizations have begun incorporating KQML and Ontologies into Mobile 
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Agent implementations, while other utilize different knowledge representation languages 
to implement Agent communication. Still, o:'iers use proprietary object languages. 

3. Problems with Prior Art 

The KQML/Ontology mechanism and other knowledge representation languages are ill- 
suited for general-purpose software applications. They require programmers to learn 
multiple languages to formally specify communications and to develop complex 
dictionaries of terms a task that is currently ill-defined. The knowledge representation 
languages are also extremely unlike the procedural and object-oriented languages utilized 
in building business and general-purpose software applications. 

The need to support asynchronous collaboration adds significant complexity to Agent 
systems implemented via knowledge representation languages (e.g. KQML) and 
Ontologies. Furthermore, there exists a class of Mobile Agents which solely require 
synchronous collaboration, e.g.. the travel agency application described above. This type 
of Agent application essentially subdivides a larger task into smaller pieces and creates 
Agents to migrate throughout the network to accomplish it. For these Agents, there is no 
benefit in die added complexity of coding in multiple languages and developing 
Ontologies, nor in the support for asynchronous communication. A synchronous 
collaboration framework in the Agent's language is the best means for these Agents to 
coordinate their results and implement adaptive behavior. 

4. Some Details of the Invention 

The dynamic synchronous collaboration framework utilizes a distributed synchronization 
point plus object-oriented abstractions to provide synchronous collaboration for Mobile 
Agents in a distributed system. The framework simplifies collaboration for applications 
which subdivide a complex problem into several pieces and farm out the work to multiple 
Mobile Agents. 

This framework enables Mobile Agents within an application to perform synchronous 
collaboration with one or more affiliated Agents in the application's native language. This 
is accomplished via ihcAyciu Group abstraction. Agents wishing to collaborate with each 
other must belong to one (or more.) of the same Agent Groups. The fundamental principle 
behind Agent Group collaboration is that Mobile Agents performing sub-computations, 
possibly on different nodes in a distributed system, will need to periodically correlate their 
results, and potentially adapt their behavior based on the results of the correlation. The 
Ageui Gump acts as distributed .syiichroiii/.iitioii point ioi ihk type of synclmmuus 
collaboration. 
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Patent Disclosure lor Dynamic Synchronous 
Collaboration Framework lor Mobile Agents 



1. Introduction 

This document serves as a patent disclosure on the invention entitle d/5 v/j«//iic 
Synchronous Collaboration Framework for Mobile Agents. This document includes a 
discussion of: prior art. problems with prior art. details of the invention, and improvements 
of this invention over prior an. 



2/ Prior Art 

"Agent" is one of the most overused terms in the soli ware industry today. Although the 
term may be used in a wide variety ol contexts, software Agents can be classified into two 
major categories: Intelligent Agents and Mobile Agents. Although the two differ in scope 
and capabilities, both types of Agents are able to perform work asynchronously and 
autonomously on behalf of their owners. Intelligent Agents are endowed with some 
degree of reasoning and learned behavior and may make decisions on behalf of their 
owners. These Agents are generally stationary and execute on a single system. Mobile 
Agents, on the other hand, may be transported across nodes in a network, performing 
computations as they migrate. 

The original concept for Agents stems Irom the Artificial Intelligence community. The 
behavior of Intelligent Agents may be determined by programming or by decisions made 
by ihe Agents on behalf of Ihrir owners. As an example, an Intelligent Agent mav search 
a database for unusual outdoor scenery, making its own decisions as lo whether or not 
each scene meets ihe specified criteria. 

Intelligent Agents generally employ both synchronous and asynchronous modes of 
communication. Agent communication may lake the form of queries or collaborative 
computations. In the realm of Agent computing collaboiauon may be definod as "the 
coordination of the compulations of multiple Agents to achieve a desired result" (e.g.. to 
solve a complex problem). Collaboration often results from discovery (i.e. the need to 
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The dynamic nature of the Agent Group enables Agents to join and leave the croup al 
will. Hence no a priori knowledge ol the actual Agents comprising a group is required 
and group membership may change over lime. 

A distributed name space maintains a reference to each Agent Group. Hence. Agent 
Groups may be located via their entry the name space. When an Agent Group is created, 
it is automatically added to the name space. 

The Agent Group's primary responsibility is to facilitate synchronous collaboration for 
Mobile Agents. However, it also serves as a central point for distributing asynchronous 
events to Agents in the group. A typical event may be the termination of a particular 
Agent. As a sitle effect, t tic Agent Group also tracks the travels of its constituent Auents 
throughout the network. 

The travel agency example illustrates the function of Agent Groups. The problem to be 
solved can be slated as follows: A user wishes to determine the best package for a trip to 
a ski resort. The Agents must determine the best travel date and time (e.g. any week in 
February starling on a Saturday, and Hying before noon) and lodging must meet certain 
criteria (e.g., a two-bedroom condominium) . The trip includes all expenses (e.g.. air fare, 
lodging, meals, transportation, and lift tickets). The user may also specify several possible 
travel destinations. 

This application is composed of multiple Agents - each is responsible for querying one or 
more data sources (in perhaps different formats) for specific information (e.g., searching a 
particular travel agency's database of promotional trips to determine if anv meet the 
criteria specified by the user.) Some Agents may query legacy database systems, whereas 
others may search ODBC compliant databases. (The actual mechanisms for handling 
different data sources is beyond the scope of this invention.) 

Before the Agents are transported throughout the network they join a new Agent Group. 
The Agent Group tracks its Agents' travels throughout the network. At any point, an 
Agent may be in one of several states. Figure 1 depicts three Agents in an Agent Group 
performing computations and one Agent in-transit between nodes. 

Al different points during then migrauon. Agents may wish loi.unelale then results, and 
potentially change their migration plans or behavior. Suppose each A«:ent migrates to a 
local travel agency. Helore migrating to travel agencies in different cities, the Agents may 
wish to con elate their results and polentially adjust their behavior. Suppose one of the 
Agents dc;ei mines that a particular ski resort, say Taos, has no two-bedroom 
condominiums available during February. The Agents in the group may wish to drop al! 
further queries about n ips to Taos. 

Agent Group collaboration is implemented via a distributed synchronization point (also 
known as a collaboration point) and a software routine to analyze the rcsulis of each 
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Agent's computation. The Agent Group abstraction provides the distributed 
synchronization point. Fach application need only provide its own software method lo 
analyze the results and potentially allow each Agent to adapt its behavior. 

The distributed synchronization scheme requires that each Agent arrive at the 
collaboration point before collaboration may commence. Hence, it is best suited to 
applications that subdivide a complex problem into many sub-tasks that need to correlate 
their results. As each Agent arrives at the collaboration point, it posts the results of its 
computations to the Agent Group, and blocks until all the other Agents in the group 
arrive. Figure 2 depicts one Agent in the group waiting to collaborate while three others 
are still performing computations. 

The Agent Group collects the results of each Agent's sub-computation. When all Agents 
have arrived at the collaboration point, as shown in Figure 3, the Agent Group notifies 
them that collaboration may commence. When it unblocks the waiting Agents, the Agent 
Group passes the collected results to each Agent. Each Agent then calls the application- 
specific method to analyze the results and potentially adapt its behavior. Figure 4 shows 
that all Agents have arrived at the collaboration point and are now in the analysis stage. 

The synchronous collaboration framework supports both parallel and serialized 
collaboration analysis. Figure 4 depicts a parallel analysis implementation; Figure 5 
illustrates a serialized collaboration analysis, in which one Agent is in the Analysis state, 
while the rest remain waiting in the Collaborate stale. 

The distributed collaboration point may be implemented via an object transport or hy an 
RFC mechanism. It may also be implemented in any procedural or object-oriented 
language. Object-oriented languages simplify the implementation, as the application need 
only subclass the Agent Group abstraction and provide a concrete method to analyze the 
results and potentially adapt the Agent's future behavior. 

The Agent Group ensures that all Agents in the group arrive at the synchronization point 
by tracking the Agent's migration through the network. In the current implementation, as 
part of a mobile Agent system, a server (known as the Conduit Server) on each node 
manages the Agent's migration and informs each of its Agent Groups when the Agent 
arrives and departs. Should an Agent fail to arrive at a collaboration point in a pre- 
determined, configurable length of time, the Agent Group will "ping" the Agent by 
sending a message lo ensure that it is still alive, as shown in Figure 6. (In the current 
implementation, this is performed via the Conduit Server on the node where the Agent is 
executing.) If the Agent fails to respond lo the ping, the Agent Group notifies the other 
members of the group by distributing a Collaboration Failed asynchronous event to Lhem 
that indicates that a particular Agent is not icspondmg. The Agents may then indicate 
whether or not they wish lo proceed with the collaboration. Figure 7 depicts the Agent 
Group's distribution of a Collaboration Failed event followed by the remaining Agents 
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indicating that they wish to continue the collaboration. Alternatively, the Agents could 
decide to ahort the collaboration. 

The Agent Group also implements deadlock detection by means of the time-out 
mechanism and Agent ping described above. The ping actually returns the state of the 
Agent in question (via the Conduit Server). If the Agent is already in the Collaborate slate 
but has not arrived at this collaboration point, a deadlock has occurred. This is shown in 
Figure 8. In this case, the Agent Group will abort the collaboration and notify ihe Agents 
in the group of the deadlock by sending them a Deadlock Fvent. as shown in Figure 9. 
Note that since Agent Group collaboration is designed for closely coordinated Agents, the 
existence of a deadlock is generally a result of a programming error. Hence, the Agent 
Group does not need to employ a more sophisticated scheme for deadlock detection or 
avoidance. 

Agent Groups provide reliability by saving the stale ol'each Agent in the group to 
persistent storage. If the Agent Group should terminate unexpectedly, it is restarted and 
reads the state of the group members from persistent storage. The Agent Group's restart 
is transparent to the AgenLs. They actually communicate with an Agent Group Proxy 
(instead of an Agent Group), which shields them from Agent Group failures. 

Figure 1 i illustrates the flow of a typical collaborating Mobile Agent. Ilach Agent creates 
an Agent Group Proxy for each Agent group it wishes to join. The proxv's primary 
responsibility is to maintain an active connection to its associated Agent Group and to re- 
establish the connection or re-create the Agent Group, as needed, during Agent Group 
failures. 

When the Agent Group Proxy is initialized, it establishes a connection with the appropriate 
Agent Group. It first attempts to find a reierence to it in the name space. If this fails, it 
creates the Agent Group and enters a reference to it into the name space. The algorithm 
guarantees the atomicity of this operation. 

After the proxy has created the Agent Group or established a connection to it, the Agent 
continues its computations and migrations. Fventually. it may attempt to collaborate its 
results. This is accomplished by means of the Agent Group Proxy. If the Agent Group 
has failed or is in a unknown stale, the proxy will be unable to contact it. If this occurs, 
the Agent Group Proxy retries the communication. If. at this point, the proxy is still 
unable to communicate with the Agent Group, it recreates it and updates the name space 
with a reference to the new Agent Group. The re-creation of the Agent Group is serialized 
to prevent multiple Agent Group Proxies from simultaneously doing so. If a proxy 
determines that the Agent Group is in the process of being re-created, it simply waits until 
it can find a reierence to the new group in die name space. Once the Agent Giuup has 
been re-created, the proxy retries the collaboration. 



Mitsubishi Electric 1TA Confidential 
6 



BNSDOCID: <WO 9821662A1 _!_> 



WO 98/21662 PCT/US97/20232 
Patent Disclosure for Dynamic Synchronous Collaboration Framework for Mobile Agents 



As mentioned earlier. Agent Groups provide a distributed events mechanism in addition to 
the synchronous collaboration framework. The distributed events mechanism enables the 
Agent Group to notify members of the group of outstanding events, such as the 
termination of an Agent, or the detection of a collaboration deadlock. Agents may build 
on this mechanism to lorward application-generated events to other members in the group 
Hence, if an Agent catches an application-generated exception it may notify the other 
Agents in the group before terminating. Figure 10 illustrates how the Agent Group 
forwards an lixception livent. generated by one of its Agents, to the resfto the group. 

Currently, the Agent Group handles distributed events by maintaining a (possibly remote) 
reference to an event queue associated with each Agent. The Agent Group forwards all 
events it receives to the other members of the group by enqueuing it. The Agent Group 
may be implemented without a remote referencing capability, but this wouidadd 
significant complexity. In the current implementation, each Agent contains an events 
thread which is responsible for dequeuing the event and calling the application-specific 
event handler. (This thread could easily be a process, if threads were not available. ) 

In addition to forwarding events to members of the group, the Agent Group may generate 
its own event* and distribute those to the group members. As an example, the Agent 
Group distributes a Deadlock I -vent to the group members when its detects a deadlock 
situation, as illustrated in Figure 9. 

As mentioned earlier. Agent Groups track the migrations of their constituent Agents, with 
help from the Conduit Server (in the current implementation). If an Agent is in transit 
when the Agent Group is forwarding events, it queues the events locally, as shown in 
Figure 10. Once the Agent arrives at its destination, it notifies the Agent Group, via the 
Conduit Server. The Agent Group then flushes the events it stored locally for that Agent. 

Agent Groups implement varying levels of persistence, as defined by the actual 
configuration. Memberships and Agent states are updated infrequently, so lhey are 
generally written to persistent storage. However, local queues maintained on behalf of m- 
transit Agents may also be saved in persistent storage, if desired. 

Implementation of the /Vvnt Group in ;;n obje;;i orienirti language enables application.*; in 
extend its functionality, if required, by subclassing the Agent Group object. 

5. Benefits of the Invention 

The work described above: provides several beneliis. It trreallv simplifies the 
implementation oi synchronuiis collaborating Mobil- ,'^v.nts. rspeciallv for applications 
that subdivide a complex task into a series of related sub-tasks. There is no need for 
application developers to learn knowledge query representation languages, such as 
KQML, or to develop complex Ontologies. The dynamic synchronous "collaboration 
Iramework provides a natural programmatic implementation that may be programmed in a 
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number of languaues. An added benefit of tins scheme is that collaboration is 
implemented as pan of .he application, programmed in the same language as ,he rest ol 
tins application. The current impleinenialion in an objcct-onenicd language (Java, also 
enables the technology to be easily extended so that more complex miclhgcnce schemes 
may be supported. 

Aoent Groups facilitate Mobile Agent Lacking and may also be queried by tools thai 
mtlor Agents. In addition, collaboration may be performed through discovery, as wuh 
many knowledge representation languages. 

Aecni Groups also offer reliability by providing persistent Agent Group membership and 
A~ Sue" nformation. Furthermore, Agent Group Proxies shield Agents .rom the 
effects of Aeent Group failures. They detect an Agent Group's la.lure and automat.uilly 
restart the failed Aaeni Group (which then restores the state of its membership Iron, 
nen'stent storaee) 'and retry the current operation (e.g.. collaboration). The algorithm 
also guarantees the atomicity of Agent Group creation and re-creation. 

An Aoent Group also detects Agent failures and deadlocks and forwards this information 
U) th/other members of the group via its distributed events mechanism . l urthenuore us 
mechanism allows Mobile Agents to asynchronously notify associated Agents ot .elevant 
events, such as the catching of an exception. 

Implementation of Agent Croups in an object-oriented language also enables additional 
applicat.on-specific functionality to be easily added via inherence and poly.norph.sm. 
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Design Specification for Java Agent 
Cooixiination 

Version 02 1 
1. Introduction 

Java aucnts have the capability of coordinating their activities. This coordination takes two 
main ionus: synchronized collaboration aiul asynchronous nt itilUat it»ns. Those tmxies of ^ 
communication complement each other ami their implementations aie related. 

Collaboration 

The collaboration paradigm is implemented as follows: 

• multiple agents perform computations at different nodes in the network; 

• alter performing all or a subset of their operations, agents wait at a distributed 
synchronization point until ail agents have "arrived"; 

• aiiem> coordinate bv potcniiaMy serialized execution of a .syncluoni/cd method. 

( Ordination can take the form ol performing computations on intermediate results and/or 
updating agent itineraries. 

Notification 

The notification scheme uses a distributed events mechanism to communicate agent state 
changes that occur asynchronously, it is mainly utilized for distributed exception handling 
but mav also be used to notify related agents of events, such as another's termination, 

As described alx>vc, agent ctxirdmatiou utilizes distributed synchronization and event 
hamtlmt!. However. Java possesses neither of these. Actually, us synchronization primitives 
are limited u> ethical sections on a single system and a notiltcaiion scheme that can only 
handle a single type ol event. Ilcncc, a great deal of the complexity in the task of agent 
coordination is comprised of implementing mechanisms to overcome Java's unsuitability for 
distributed processing. These mechanisms ate described in the remainder of this document, 
along wiih the new objects that implement them 



1 Revision Hisioiy: 

07/26/% Version 0.1 Initial revision. 

1 1/12/% Version 0.2 Major changes to Notifications ami Inceptions and Collaboration sections to 
reflect actual implementation. Removed l-vents section. 
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Synchronization 



As mentioned above, agent coordination requires distributed synchronization mechanisms, 
such as locks and events. Since Java docs not provide any disinhnteil locking, we are faced 
with the following choice: 

1. Utilize a centralized locking scheme. 

2. Develop our own distributed locking paradigms. 

.V Use Java's native methods to mteiiaee with the operating system's synchronization 



The latter choice is unacceptable localise it compromises the portability ot our agent 
infrastructure, whereas the first option may potentially introduce considerable network 
overhead. The second alternative also requires significant development effort even to 
implement a well-known solution to the problem. 

In the interest of expediency (as required by the tightness of our schedule), the initial Java 
agent infrastructure utilizes KMI to implement a centralized locking scheme. Locking is 
implemented via method invocations on a potentially remote object (called an AycntGroup. 
See Section 3 for details.) Agent coordination is implemented by (remote) invocations on a 
method which requires syncluoitr/ed access. (See Section .V) 



Agents that may wish to collaborate their results subclass CoHnbontiotAycru, an abstract 
class derived from Agent. ( otlahoraior Agent contains a minimum of two threads - one to 
perlorm computation and to travel and another to handle asynchronous event notifications. 
Applications that contain collaborating agents subclass ( 'olIaboraiorAgent and, ot course, 
these derived classes may implement several computation threads. 

l-ach collaborating agent belongs to one or moic agent groups, which are dcscrilx:d by Agent 
(iioup objects. Agent (iioup is actually a distributed KM I object AyentGroup defines the 
interface; AyentGnntpintpl, an abstract base class derived from Pcrststenti'.ventGnmphnpl, 
provides the implementation (Sec Design Speajicar.un for l>ivnbtttcrf Java Events for a 
description of IVrsistenihvenlC nouplmpl.) 

An AgentCrrottp is essentially a unit of coordination llcncc agents may coordinate: with all 
(Jie oihei agents in an Ag».-m(. iioup They may also create new Agt'utl'iroiips on demand, and 
join and leave groups at will (hi practice, AgeiuCiroup must be sul>classcd to implement 
agent collaboration. I lowever. this document does not distinguish between the base class ami 
its derived classes and refers to them collectively as Ageni(ironps) 

An /-.genii iioup is an object that is essentially shaied among the incmlx-.rs o! an agent 
coordination gioup. h is owned by the Agent dial initially creates the gioup (an agent group 
is created by instantiating Agcnt(iroup) and accessed via a potentially remote UMI reference. 

The relationship between (.'ollalx)raiorAgeni and AgentCiroup is similar to that of Thread 
and Thread! iroup: A ThreadCiroup maintains references to the Threads composing the 
group; an AgeiuCiroup maintains a similar list of its Collaborator Agents. Uoth 
ThreadCiroups and AgenlGroups form a hierarchy and each contains a reference to its parent 
group. Thread's constructors are either passed a reference to a ThreadCiroup or they save a 



primitives. 



3. 



ColIaboratorAgent and AgentGroup 
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reference to the parent's Thread's group. Likewise, CoIlaboratorAgcnfs constructors may be 
passed one or more AgenK iroups or save a reference to AgentCiroup of its parent, it it exists. 

However, there in one noticeable difference between liie two types of groups. A Thread may 
only belong to otic ThieadCiroup at a lime, whereas a CollaboraiorAgeni may simultaneous!) 
Ix: a member of several AgcnU iioups. which constitute a hierarchy. Hence. Threads contain 
a reference to their associated Tliread( lump. I>ut t 'ollaborator Agents maiuiain a list ni 
references to tlieir Agcnt( iroups 

Support for multiple AgcnU iroups facilitates coordination anions related groups ot agents 
and also enables the creation of an AgentCiroup hierarchy through which communication 
may Ix; propagated. The pilot application may utilize multiple agent groups, as shown in 
l iguie I . 

This figure portrays an example of two AgentC iroups: AgentCiroup A consists of three 
agents - one on each LAN in the system, whereas AgemCimup H contains agents on multiple 
nodes on LAN 3 A distributed application running on a configuration such as this typically 
creates multiple AgentC lamps, when it needs to traverse the WAN. In this case, 3 agents are 
created in AgcnKiioup A. one lor each LAN. ( )nce they arrive on a mxle, these agents clone 
themselves, creating more agents to Ik distributed across mxies on the LAN (e.g., 
AgentCiroup Hi. This approach minimizes network traffic over the WAN and forms a multi- 
level hierarchy of AgetitC iroups Agents in the inira-LAN groups (e.g.. AgentCiroup B) can 
communicate then results, which can then Ix; coordinated with the inter-LAN group (i.e., 
AgentCiroup A) 




I'igure I: Multiple AgentC iroups 
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By default, RMI passes all local objects by copy. However, the above scheme requires that 
each Agent actually maintain (remote) references to its Agenit iroups. Hence, the agent 
infrastructure overrides some of UMI's object serialization mctluxls to generate the required 
references. 



Notifications and Exceptions 

lioth asynchronous notification and collaboration ate implemented vta the associated 
AgcniGroup object. 1 lie following description serves as an example of asynchronous 
notification handling via distributed events. (See Design Specification jor Distributed Java 
Events for more details on event handling.} 

I An agent catches an exception and wishes to nottly the oilier members of (he gioup. 

2. The agent posts an A^enil.xceptU'nl'.vem to the AgenU iroup via the group's post Event 
method The AgentHxccpiionlivent indicates the type of exception thai occurred 

3 The AgenU iroup posts the Ageuil ■xccpiionl-.vciu to lite other agents in the group 

4. fiach agent's P. vent Handler performs application-specific handling of the_ 
I : .xceptionL:vent 

If the agent thai caught the exception wishes to notify another associated Agent ( iroup, K 
repeals the above procedure with the next AgenK iroup object. 

Occasionally, the Agent Group may geneiate events thai a directly iorwards to a memlxji of 
the group (e.g.. to "ping" it after it fails to arrive at a collaboration point) or others that it 
"multicasts" to its members (e.g., an Agent's failure to reply to a ping). 



yM : :- 



Collaboration 

Agent collaboration is more complicated (ban asynchronous notifications It is implemented 
;ls follows: 

1. An agent performs some compulation and arrives ;it a synchronization point. 

2. The agent performs a (remote) invocation of the Agentt iroup's collaborate mcilnxl, 
passing it an A^ent Stains object. 

3 If no collaboration is iu-progress (i.e.. this is the fust agent ihat has requested 
collaboration), collaborate calls its synchronized bcvinCullaboratc method, which 
initializes the number of agents u> wait lor before collaboration may l>egin (i.e.. n- \ for 
an >i-agetu group ) (Race conditions are handled hy checking if the agent count has 
been initialized (i.e.. ii is nou-zcio) l»efoie continuing, A lace implies dial iwu avents 
aie attempting io initiaie tiie same collaboration. Otherwise the application is 
semnntically incorrect.) This routine saves the requesting agent's unique 10 (obtained 
from the AeemStatus object) and starts a collaboration timer (with sufficient time for 
agents to arrive across the WAN) by passing a configurable time-out value to the 
AgeiuGroup's wait method. 

4. Otherwise (i.e., if a collaboration is in-progress). collaborate calls the synchronized 
decremeiuColhthoraic method to add the requesting agent's unique ID to the list of 
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agents arriving al the collaboration point and tn decrement (he waiting agent counter. II 
the counter is mm-zcrn, (his method blocks with no time-out value. Otherwise, the 
Agent (inuip awakens the other threads waiting lor collaboration to commence. 

5. If the timer expires, all agents mil not arrive at the collalxtratiou point in tune. This 
may occur localise an agent received an uneaughl exception ami terminated 
unexpectedly or because a deadlock condition exists. (Since agents may Ixtlong to 
multiple groups, overlapping collalxirations could result in deadlock. However, a 
properly coded application will not generate deadlocks Ixcausc the collaboration points 
must Ix: known a prion and must be executed in the same order among collaborating 
agents, i.e., collaboration must first handled at the leaf Agent Group and propagated up 
the hierarchy.) If a tune-out occurs, the Agent Group thread initiating the collaboration 
(on behalf of its associated ( 'oIlahoratorAgcnt) is awakened and performs the iollowmg; 

• It calls the AgcuK iroup's cficckCallaborate method which returns the collaboration 
state (either CoilabotdttonSiuceci/eri or Collaborationh'ailed, depending on the 
value of die wailing agent count). 

• If the collaboration tailed, die collalx>raie method calls recoverCi>llaborate. This 
method attempts to communicate with the agents that did not arrive al the 
collaboration point by "pinging" them. (It determines these agents by comparing the 
list of arrived agents with the group membership.) The ping is actually performed 
via a message to the Conduit Server on the node where each agent was last known 
to be executing. If the agents are hxated and any of them is in the Collaborate state 
and but has not arrived at this collaboration point. ;t collaboration deadlock has 
(xrcurred and the collaboration slate is set to Collaboration! hadlock. If any of the 
agents cannot be located, the collaboration state is set to ( ollalxwationi -'ailed. 
Otherwise, it is set to CollaboratumRcin and the Agent Group thread retries the 
collalxiration up to a configurable number of limes (alter which the slate will tx i set 
to Collaborationlailcd if the collaboration still limes out.) 

• The initiating Agent Group thread wakes up the oilier hhxkcd threads by calling 
notifvAll on the AgenU iroup. 

h. Once all the collaborating Agent Gioup threads have been awakened, (either Ixcause the 
counter has dropped to 0 or a time-out occurred), they call the AgenK iioup's 
checkCollaborate method. If this method returns a slate other the 
CotlnborationSuccecded. each thread returns the appropriate exception (i.e., either 
CoHaborationFailedExceptton or CollaboratiunlkarilockExcepttoiw to its invoking 
ColtaboratorAgcni. 

7. If the collaboration state in CollaboratiouSucccedcd. collaboration commences by 
executing a potentially synchronized application-specific method, analyze Ke suit s> to 
perform the collaboration. analy/eKcsults is an abstract AgentGronp method that must 
Ix* implemented by derived classes to perform application-specific collaboration As ;i 
iCMill of collaboration, agi-m iiinciancs may be updated 

tS. As each thread completes its collalxiralion, u replies to the remote collaborate 
invocation, passing any state specified by the implementation, (e.g., updated itineraries). 

l ). The agents then continue execution on their current mxlc and travel as required by their 
itineraries. 
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As described above, collaboration requires complex mechanisms. However, mosi of these 
are necessitated by the h:niieil synchronization primitive* provided by Java. 
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Design Specification lor Distributee! 
Java Events 



Version 0.2 



i 



1. 



Introduction 



This document describes a ycncral-purposc solution to distributed event management. 



'I bis section provides ;i hnih-levcl description of the objects Mutt implement the distributed 
events haiucwoi I. 



I -veins are descried by classes that derive from EvauTy/h: l-ach HvcniType object 
includes; a unique ID l;i Sinna) generated by the constructors and a description of the event 
(a String) optionally passed to the constructors. 



The Evan Handler interface specifies the lutndlcEvcnti \ method which implements an l.ivent 
Handler. Hach application must provide iis own Hvcnt Handler to perform application- 
specific event management. 



Event Notification 

The Evenil'usi interface specifies the postEvcnfi) method which implements event 
notification. Several of the classes described below implement this interface. 

Event Que 1 .::; 



/Vi l v object reci'i viii!' notification of events must own mm I -vent Queue and an associated 
thread that manages the queue. The i.vent Queue s constructor is passed an l-.veutl laudler 
stub. It instantiates an Event ijiteuc'lnrcad (a proiccicu class derived from Thread) to 
manage the queue and passes die I : /. cut Hand lei siul> to it:, coasmicior. The 
MventQueucThread's nm() method removes events from the queue and calls the 
handlel-ventO method. 



1 Revision History: 

09/26/96 Version 0.1 Initial revision. 

1 1/12/96 Version 0.2 l-lxpanded discussion of Hvent Manager and liveni Ciroup. Added Reliubiltly 
Features and Garbage Collection sections. 



2. 



Overview 



2.1. Objects 



Events 



Event Handier 
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An Fivcni Queue is ;i distributed UMI object. RvcniQuciicImpI implements me Event Post 
interface by appending the specified 1-ventType object to die queue and calling die associated 
EventQuetteTh read's notifyi) method. I ms action wakes up die 1-vcniQueueThread tit ii was 
blocked). The thread dicn proceeds to dequeue each pending event and pass it to the 
handlehventO method 



'Hie hvent Manager handles the registration, posting, and notification of events When 
objects request notification ot specific event types, they must pass the I -vent Manager a 
reference to their hvcutPoM interlace. The Hvcni Manager saves the reference in a hash table 
that it uses lo map event types u> dieir notification requests. When an object posts an event 
(via the I -vent Manager's postHventt ) method), the I -vent Manager obtains the list ol objects 
lo notify from the hash table and calls each of their postKvcnlO methods. 

The Hvent Manager also maintains a hsi ol objects (hat have icqucsicd notification of all 
events. Whenever it receives an event, the Hvcnl Manager also lorwnrds it to these objects, 
by calling each of their postlweiuO methods 

KveniMauagci is an KMI distribuieii oh|eci. Event Manager descrilx;s the interface, whereas 
Ev e in Manager I mpl provides the implementation. 1-ventManager defines methods to manage 
event registrations (e.g., add and delete registrations). 

l-vcmManagcrlmpl also implements the hvcntPost interlace lis postHvcntO method is 
passed an event from its originator and noli ties the recipients of the event by invoking their 
postHventO methods. 

At most one I -vent Manager runs on each node in (he Agent system . A reference to it can be 
obtained via the KMI Registry. 



Event Group 

A iiroup of objects interested in a common set of notifications may form an l-vetu Group. 
HventGroup is a distributed KM I object: EventGroup defines the interface; Event Gnmplmpi 
consists of the implementation. HventGroup defines methods that manage the group (e.g., 
add and remove members). 

Whereas the Itvent Manager filters posted events on behalf of its clients, forwarding them 
only the events they requested, the I -vent Group performs no filtering. l-vciiiGrouphnpl 
implements the liveniPost interface. However, its postHventO method forwards each event it 
receives to every member of the group (by calling their posil-vemO methods). 

ir. practice, i-.^ent t iroups should tie used sparingly lx<;aus<' they could allow an abusive 
application to gene* ate unwanted notifications. The Agent Uamework does utilize this 
mechanism, hut it verifies that all events are genciatcd by a group member and it only 
utilizes the l-vent Group for some well-known events, such as die termination of an Agent. 

l.-iach hvent Group is idcntilied hy a unique name either passed to us consi;»ki»>r or assigned' 
by it. Objects may obtain a handle to a particular Hvent Group by presenting the KM! 
registry with this unique name. 

2.2. Reliability Features 

The Distributed Hvents framework incorporates several reliability features. These generally 
take the form of persistent state and proxy objects. 



Event Manager 



Distributed Java Events (1 1/12/96) 



3 



BNSDOCID: <WO 9821662A1_I_> 



WO 98/21662 



Mitsubishi Eloctric ITA Confidential 



PCT7US97/20232 



Event Manager 

The Distributed livcuis fraincwuk shields objects from the effects of livenl Manager failures 
in (wo ways: 

• hv savins its slate (i.e.. event registrations) topctsistent storage, and 

• hv encapsulating us functionality in a pioxy object. 

[ lie Invent Manager saves liie following items in ilie peisisicnt store: 

• (lie hash table mapping specific event types lo the objects registered to 
receive them and 

• the list of objects to be notified of all events 

liach time an object cither registers or "unregisicis its interest in receiving any (or all) 
events, the I -vein Manner writes the updated event registrations (i.e.. either the hash table or 
t ho list of obiects, hut not hnih) to persistent storage via the Persistent Storage Manager. 
These are lairlv infrequent operations, so the performance impact of this process should be 
negligible. (See Design Specification Jw r Java A\>e.tu Persistence Package for details on the 
Persistent Store Manager, i 

Whenever the livenl Manager is started, its initialization civle attempts to recover any 
existing event registrations front persistent storage. Hence, registrations are not lost when 
the livenl Manager fails. 

In addition, the I -vent Manage! Prosy ;dso pieveuts Objects muu experiencing the elfects of 
livenl Manager failures. It acts as a wrapper object lor the I -vent Manager. I-ach Object 
wisitiiiii to communicate with the I -.vent Manager hum lirsl create an l.vcntMana^ci f/uiv 
object. The proxy obtains a reference to the I- vent Manager via the KMI Registry. If, at any 
point, the proxy is unable to communicate with the Pvem Manager, it will attempt to obtain 
a new reference from the registry It will retty tins operation several times before throwing 
an exception. 

Furthermore, if the livent Manager should lad. it will automatically Ix: re-started by the Java 
Agent System. 

Persistent Event Group 

The i;isinhuted i -vents iiamcwo;;; provuie:; a gene; at -purpose implemciuaiioii 01 P. vent 
(iroups (i.e.. P.vcnt( iroupi. as described ai>ove However a also provides a reliable 
irnplcmcniaiion of I -vent (iroups: Persistent Pvcul tiroups. Persistent P.vcjU Group is a 
distributed KM I object that extends liventliruup the interface is defined by 
Persistenil:veniGroni> and the implementation is provided by I'ensicntUventitwuplmpi. a 
subclass of P.veuH ironpnupl Persistent i-veni < iroup miti/es persistent storage in iniidi ilu i 
same manner as the I -.vent Manager. Whenever an Ohiecl joins or leaves the gioup, it, saves 
a reference to it in persistent storage. 

Liach Persistent I ■ vein (iroup is also encapsulated in a proxy object: 
l>ersistctul-lveMUivuf>l'r(h\v. This proxy operates somewhat differently than the livenl 
Manager Proxy, depending on how it is constructed. In some cases, it will attempt to locale 
a named Persistent l-vcnt (iroup in the KMI registry. If a name is not supplied to the 
constructor, it will create a new Persistent livenl (iroup and register it. 
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Since I • vent Groups are temporary objects, unlike the Hvent Manager, which is a persistent 
server, their proxies cannot expect their associated Persistent I -vent Groups to be 
iiutoinaiically re-started upon failure. Hence, a proxy may re-create the group if it is unable 
to obtain a reference to il alter sulficient teirics. 

This, however, introduces a race coiulition wherein nuilliple proxy objects may 
simultaneously attempt to re-create the Persistent I-veiit Group. This is handled by the 
following mechanism: 

o If the owner of the Persistent Kveni (iroup detects the failure, it re-creates 
the group. { The owuei is defined as the proxy that initially created the 
group.) 

• If the owner docs not detect the failure in a configurable length of time, 
other proxies may attempt to re-create il. 

• The Persistent i-vcni (iroup is rc -created via the following steps: 

• Attempt to create a leinporary binding in the KM I name space with a 
well-known name derived from the Persistent (went Croup's unique 
name. 

• It the binding divs noi return an Alrc(ui\hi>nneilixccf)lion, proceed to 
re-create the Per lentHvcuiC iroup and then remove the leinporary 
binding. (Otlierwnse. another proxy is re-creating il. So wait for its 
completion.) 

2.3. Garbage Collection 

liolh the 1-vent Manager and livcni (iroup objects muM !>c prepared 10 garbage collect stale 
references. T his is simply pcilorincd by deleting any objects (i.e.. HvcntPosi stubs) that it 
cannot communicate with. Hence then posil-venii) methods handle garbage collection alter 
notifying all interested objects of the event. 

3, Changes to Agent Implementation 

CollaboralorAgent 

The CotlaburatotAi>e.iu class contains a reference to an event queue (i.e., an 
l-ventUU'.Mietmpl object), which is instaniiaicu by as constructors. 

The Hvcni Queue does not persist across an Agent's travels. Hence, its pvv.pttreFnrTnmsitO 
method Hushes the queue and voids the Agent s reference to the queue before it travels. Its 
associated Agent Groups save any events that occur while the Agent is in-transit. The 
vatntilcnut'l'iunsttunw i:k:iIioO. called altct the Agrni arrives at lis destination, constructs a 
iu:w ' r.veniQueueimpI ohjci.t and ihi.s!-<v. events .>a-..d by the associated Agent Groups 
while the Agent was in-transit. 

AgentStatus 

The AiientStaiK.s class contains a reference to the 1-veniPosi interlace implemented by the 
Collaborator Agent's l-iveni Queue, il also contains an Agent's unique ID and current status. 
Hence, il will serve as both an Hveni Queue and a status indicator. 
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AgentGrouplmpI 

The AgentGrouplmpI class derives from PersisieniHvemGroupImpl. Thus, it not only 
enables Agent collaboration, hut also provides reliable group eveiu handling. 

As ;t result, Agent (lamps may implement different levels of persistence: Group 
membership is always whiten to persistent storage, but queued events for in-transit agents 
will also be saved if die Agent ( i roup's conligtiralion allows it 

Occasionally, the Ageiu Group may generate events that it directly forwards in :\ member of 
the group (e.g., to "ping" it after it fads to arrive at a collaboration point) or others that it 
"rnult ica.sts ' 10 its members (e.g.. an Agent's failure to reply to a ping). Group mcniturs 
may also broadcast an event to die group (e.g.. an Agent may inform the group that it has 
encountered ;ui exceptional condition). 

AgentEvent 

The A^cntiA'cm class is die superclass of all events generated by Agents. It includes the 
Agent's unique II). 
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CLAIMS 

What is claimed is: 

1. In a computer network including at least a first 
5 computer and a second computer, an apparatus for performing 

a task in a second computer, comprising: 

a routine that generates a mobile agent object in the 
first computer, the mobile agent including both data and 
executable code; 

10 a protocol for transmission of the mobile agent from the 

first computer to the second computer, wherein execution of 
the mobile agent in the second computer following such 
transmission prompts the task to be performed in the second 
computer; and 

15 an itinerary containing a reference to each destination 

computer to which the mobile agent is designated to migrate 
and a reference to a method associated with each respective 
destination computer reference, the respective method being 
invoked when the mobile agent is present on the respective 

20 destination computer. 

2. The apparatus of claim 1 wherein the transmission 
protocol includes a routine in the first computer for 
serializing the mobile agent to generate a stream of data 
25 therefrom. 

3 . The apparatus of claim 2 wherein the transmission 
protocol includes a routine in the second computer for 
deserializing the stream of bytes to regenerate the mobile 
30 agent therefrom. ' 

4. The apparatus of claim 1 wherein the task is data 
gathering, and wherein the mobile agent is transmitted back 
to the first computer from the second computer following 
35 completion of such data gathering. 



The apparatus of claim 1 wherein the mobile agent. 
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migrates to a plurality of destination computers within the 
computer network. 

6. The apparatus of claim 1 wherein at least one 
5 destination computer reference is a Uniform Resource Locator. 

7. The apparatus of claim 1 wherein at least a portion of 
the executable code required for invoking the method is 
retrieved from a mobile codebase portion of the executable 

10 code included in the mobile agent. 

8. The apparatus of claim 7 wherein the mobile agent 
includes a reference to a home codebase located on the- first 
computer, the reference being employed to retrieve required 

15 executable code which is not present in the mobile codebase. 

9. The apparatus of claim 8 wherein required executable 
code is sought first in the computer on which the mobile 
agent is executing, then in the mobile codebase, and finally 

2 0 on the home codebase. 

10. The apparatus of claim 8 wherein a new thread is formed 
for execution of the mobile agent in the destination computer 
following receipt of the mobile agent, and wherein a security 

25 feature prevents the mobile agent from operating outside a 

scope assigned to such thread. 

11. The apparatus of claim 8 wherein the mobile agent 
further includes sub-obj ects . 



30 



12. The apparatus of claim 1 wherein a persistent local copy 
of the mobile agent is stored following receipt of the mobile 
agent, and wherein such copy is overwritten with an updated 
persistent copy following agent execution. 



35 
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13 . In a computer network including at least a first 
computer and a second computer, a method for performing a 
task in a second computer, comprising the steps of: 

generating a mobile agent object in the first computer, 
the mobile agent including both data and executable code; 

transmitting the mobile agent from the first computer 
to the second computer; 

receiving the mobile agent in the second computer; and 

executing the mobile agent in the second computer in 
accordance with an itinerary which contains a reference to 
each destination computer to which the mobile agent is 
designated to migrate and a reference to a method associated 
with each respective destination computer reference, the 
method associated with the second computer being invoked when 
the mobile agent is present on the second computer. 

14. The method of claim 13 including the further step of 
serializing the mobile agent to generate a stream of data 
therefrom in the first computer. 

15. The method of claim 14 including the further step of 
deserializing the stream of bytes to regenerate the mobile 
agent therefrom in the second computer. 

16. The method of .claim 13 wherein the task is data 
gathering, and including the further step of transmitting the 
mobile agent back to the first computer from the second, 
computer following completion of such data gathering. 

17. The method of claim 13 including the further step of 
causing the mobile agent to sequentially migrate to a 
plurality of destination computers within the computer 
network . 

18. The method of claim 13 including the further step of 
employing a Uniform Resource Locator as one of the at least 
one destination computer reference.- 
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19. The method of claim 13 including the further step of 
retrieving at least a portion of the executable code required 
for invoking the method from a mobile codebase portion of the 
executable code included in the mobile agent. 

20. The method of claim 19 wherein the mobile agent includes 
a reference to a home codebase located on the first computer, 
and including the further step of employing the reference to 
retrieve required executable code which is not present in the 
mobile codebase. 

21. The method of claim 20 including the further step of 
searching for required executable code first in the computer 
on which the mobile agent is executing, then in the mobile 
codebase, and finally on the home codebase. 

22. The method of claim 21 including the further step of 
forming a new thread in the destination computer for 
execution of the mobile agent following receipt thereof, and 
wherein a security feature prevents the mobile agent from 
operating outside a scope assigned to such thread. 

23. The method of claim 21 including the further step of 
inserting sub-objects into the mobile agent. 

24. The method of claim 13 including the further step of 
storing a persistent local copy of the mobile agent following 
receipt thereof, and overwriting such copy with an updated 
persistent copy following agent execution. 

25. In a computer network including at least a first 
computer and a second computer, an apparatus for performing 
a task in a second computer, comprising: 

a routine that generates a mobile agent object in the 
first computer, the mobile agent including both data and 

executable code; 

a protocol for transmission of the mobile agent from the 
first computer to the second computer, wherein execution of 
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the mobile agent in the second computer following such 
transmission prompts the task to be performed in the second 
computer, at least a portion of the executable code required 
for execution being retrieved from a mobile codebase portion 
5 of the executable code included in the mobile agent; and 

a reference to a home codebase located on the first 
computer, the reference being employed to retrieve required 
executable code which is not present in the mobile codebase. 

10 26. The apparatus of claim 25 wherein the transmission 

protocol includes a routine in the first computer for 
serializing the mobile agent to generate a stream of data 
therefrom. 

15 27. The apparatus of claim 26 wherein the transmission 

protocol includes a routine in the second computer for 
deserializing the stream of bytes to regenerate the mobile 
agent therefrom. 

20 28. The apparatus of claim 25 wherein the task is data 

gathering, and wherein the mobile agent is transmitted back 
to the first computer from the second computer following 
completion of such data gathering. 

25 29. The apparatus of claim 25 wherein the mobile agent 

migrates to a plurality of destination computers within the 
computer network. 

30. The apparatus of claim 29 wherein the mobile agent 
30 further includes an itinerary containing a reference to each 

destination computer to which the agent is designated to 
migrate and a reference to a method associated with each 
respective destination computer reference, the respective 
method being invoked when the mobile agent is present on the 
35 respective destination computer. 

31. The apparatus of claim 30 wherein at least one 
destination computer reference is a Uniform Resource Locator. 
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32. The apparatus of claim 25 wherein required executable 
code is sought first in the computer, on which the mobile 
agent is executing, then in the mobile codebase, and finally 
on the home codebase . 

33. The apparatus of claim 25 wherein a new thread is formed 
for execution of the mobile agent in the destination computer 
following receipt of the mobile agent, and wherein a security 
feature prevents the mobile agent from operating outside a 
scope assigned to such thread. 

34. The apparatus of claim 25 wherein the mobile agent 
further includes sub-objects. 

35. The apparatus of claim 30 wherein a persistent local 
copy of the mobile agent is stored following receipt of the 
mobile agent, and wherein such copy is overwritten with an 
updated persistent copy following agent execution. 



36. In a computer netv/ork including at least a first 
computer and a second computer, a method for performing a 
task in a second computer, comprising the steps of: 

generating a mobile agent object in the first computer, 
25 the mobile agent including both data and executable code; 

transmitting the mobile agent from the first computer 
to the second computer; 

receiving the mobile agent in the second computer; 
retrieving at least a portion of the executable code 
required for invoking the method from a mobile codebase 
portion of the executable code included in the mobile agent; 

employing a reference to a home codebase located on the 
first computer to retrieve required executable code which is 
not present in the mobile codebase; and 



executing the mobile agent in the second computer such 
that the mobile agent prompts the task to be performed in the 
second computer. 
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37. The method of claim 36 including the further step of 
serializing the mobile agent to generate a stream of data 
therefrom in the first computer. 

5 38. The method of claim 37 including the further step of 

deserializing the stream of bytes to regenerate the mobile 
agent therefrom in the second computer. 

39. The method of claim 36 wherein the task is data 
10 gathering, and including the further step of transmitting the 

mobile agent back to the first computer from the second 
computer following completion of such data gathering. 

40. The method of claim 36 including the further step of 
15 causing the mobile agent to sequentially migrate to a 

plurality of destination computers within the computer 
network . 

41. The method of claim 40 wherein the mobile agent further 
20 includes an itinerary which contains a reference to each 

destination computer to which the agent is designated to 
migrate and a reference to a method associated with each 
respective destination computer reference, and including the 
further step of invoking the method associated with the 
25 respective destination computer when the mobile agent is 

present on the respective destination computer. 

42. The method of claim 41 including the further step of 
employing a Uniform Resource Locator as one of the at least 

30 one destination computer reference. 

43. The method of claim 36 including the further step of 
searching for required executable code first in the computer 
on which the mobile agent is executing, then in the mobile 

35 codebase, and finally on the home codebase . 

44. The method of claim 36 including the further step of 
forming a new thread in the destination computer for 
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execution of the mobile agent following receipt thereof, and 
wherein a security feature prevents the mobile agent from 
operating outside a scope assigned to such thread. 

45. The method of claim 36 including the further step of 
inserting sub-objects into the mobile agent. 

46. The method of claim 41 including the further step of 
storing a persistent local copy of the mobile agent following 
receipt thereof, and overwriting such copy with an updated 
persistent copy following agent execution. 
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